(19) 


J 


(12) 


(43) Date of publication: 

19.02.1997 Bulletin 1997/08 

(21) Application number: 96112878.2 

(22) Date of filing: 09.08.1 996 


Europdlsches Patentamt 
European Patent Office 
Office europ&n des brevets (11) E P 0 758 827 A2 

EUROPEAN PATENT APPLICATION 

(51) IntCI. 6 : H04L 29/06 


(84) 

Designated Contracting States: 

(72) Inventor: Ueda, Hiroakf 


DE FR GB NL 

Minato-ku, Tokyo (JP) 

(30) 

Priority: 10.08.1995 JP 224570/95 

(74) Representative: Betten & Resch 



Reichenbachstrasse 19 

(71) 

Applicant: NEC CORPORATION 

80469 MOnchen (DE) 


Tokyo (JP) 


CM 
< 

CM 
CO 

CO 
LO 

o 

CL 
UJ 


(54) Image data communication system 

(57) A server (S) and a plurality of terminals (A, B) 
are interconnected so as to allow communication of 
image data therebetween. A terminal information 
retrieval section (26) provided in the server (S) discrim- 
inates whether or not image data requested from a first 
terminal have already been transmitted to a second ter- 
minal. An image data transfer section (25) provided in 
the server (S) requests, when a result of the discrimina- 
tion is that the data have been transmitted already, the 


second terminal for transmission of the image data and 
transfers the image data received from the second ter- 
minal to the first terminal. A terminal memory (30) pro- 
vided in each terminal stores image data, and an image 
data transmission section (32) provided in each terminal 
reads out image data requested from the server (S) 
from the terminal memory (30) and transmits the read 
out image data to the server (S). 
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Description 

This invention relates to an image communication 
system wherein image data are communicated between 
a server and a plurality of terminals in order to repro- s 
duce desired image data by a terminal. 

Description of the Related Art 

In order to transmit an image via a communication 
line, the image is digitized. However, since the amount 
of data of an image is very large, the image is usually 
compressed and coded in accordance with a compres- 
sion coding method standardized by the JPEG (Joint 
Photographic Expert Group) or the MPEG (Moving Pic- 
tures Expert Group). Such compression coding meth- 
ods are applied, for example, to a TV conference 
system, a CATV (Cable TV) system, to a VOD (Video on 
Demand) system. 

Reproduction of image information by conventional 
bi-directional communications will be described. FIG. 1 0 
shows in block diagram a conventional moving picture 
reproduction system. 

Referring to FIG. 10, the moving picture reproduc- 
tion system shown includes a server 1 , and a terminal 3 
which bi-directionally communicates with the server 1 
via a line 2. 

The server 1 includes a server controller 4, a server 
communication section 5, a server memory 6, and a 
storage section 7 in which a plurality of image data 
(moving picture codes) are stored as an image data file 
7a. Meanwhile, the terminal 3 includes a terminal con- 
troller 8, a keyboard 9, a terminal communication sec- 
tion 10, a terminal memory 11 and a decoding section 
12. 

In the moving picture reproduction system, desired 
image data are selected using the keyboard 9 of the ter- 
minal 3, and a request for transmission of the image 
data is issued from the terminal 3 to the server 1. The 
server 1 retrieves and reads in the requested image 
data from the image data file 7a and sends the image 
data to the terminal 3. In the terminal 3, the received 
image data are decoded and reproduced by the decod- 
ing section 12. 

In a moving picture reproduction system of the type 
described above, where a plurality of terminals are 
involved, since an image data request from each termi- 
nal is sent to the single server, it sometimes occurs that 
transmission requests for the same image data are sent 
to the server within a short period of time. In this 
instance, since processing of retrieving and reading in 
the same image data from the image data file 7a is 
repeated, the moving picture reproduction system has a 
drawback in that the server must perform wasteful 
processing. 

One of improved systems which eliminates the 
drawback just described is disclosed in Japanese Pat- 
ent Laid-Open Application No. Heisei 5-83259. In the 
improved system, two local area networks (LANs) are 


interconnected such that when a terminal of a first one 
of the LANs is utilized to communicate data between 
two servers of the second LAN, a virtual line is estab- 
lished between the servers of the second LAN in 
response to the request from the terminal of the first 
LAN so that data are directly communicated via the vir- 
tual line in order to perform transfer processing rapidly 
eliminating such wasteful processing as described 
above. However, the system just described is disadvan- 
tageous in that, since a virtual line must be established, 
it is complicated in construction. 

Another improved system is disclosed in Japanese 
Patent Laid-Open Application No. Heisei 5-258026 and 
Japanese Patent Laid-Open Application No. Heisei 5- 
274398. In the second-mentioned improved system, a 
single program for performing image processing and 
transfer and a plurality of programs indicating the single 
program are executed to transfer a large number of 
image data without communications between applica- 
tions. With the system just described, however, since a 
plurality of programs must be executed simultaneously, 
apparatus of a high performance are required. 

It is an object of the present invention to provide an 
image data communication system of a simple con- 
struction wherein wasteful processing is eliminated so 
that desired image data can be transmitted rapidly to a 
terminal of a source of a request for the image data. 

In order to attain the object described above, 
according to the present invention, there is provided an 
image data communication system which includes a 
server and a plurality of terminals and wherein image 
data are communicated between the server and termi- 
nals, comprising transmission discrimination means 
provided in the server for discriminating whether or not 
image data requested from a first one of the terminals 
have already been transmitted to a second one of the 
terminals, image data transfer means provided in the 
server for requesting, when a result of the discrimination 
of the transmission discrimination means is that the 
data have been transmitted already, the second termi- 
nal for transmission of the image data and transferring 
the image data received from the second terminal to the 
first terminal, terminal side storage means provided in 
each of the terminals for storing image data, and image 
data transmission means provided in each of the termi- 
nals for reading out image data requested from the 
server from the terminal side storage means and trans- 
mitting the read out image data to the server. 

Preferably, the image data communication system 
further comprises server side storage means provided 
in the server for storing a terminal information file includ- 
ing an address number of the second terminal and a 
name of the image data transmitted to the second termi- 
nal and an image data file including a plurality of image 
data, the transmission discrimination means referring to 
the terminal information file to discriminate to which one 
of the terminals the image data have been transmitted. 

Preferably, image data are transferred as packet 
data together with an address number of a destination 
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and an address number of a source of transmission. 

Preferably, the image data communication system 
further comprises a router for transmitting the image 
data toward the terminal of the destination based on the 
address number of the destination included in the s 
packet data. 

With the image data transmission system, when 
transmission requests for the same image data are 
received from a plurality of terminals, the server need 
not repeat the same retrieval operation, and the image 
data can be transferred from the second terminal side 
via the server to the first terminal which is the source of 
the request for the image data. Consequently, the 
desired image data can be transferred rapidly to the ter- 
minal of the source of the request while the image data 
transmission system is simple in construction. 

Further, since image data stored in the terminal 
side storage means are utilized, a storage device of the 
server side including the server side storage means can 
be utilized effectively. 

The above and other objects, features and advan- 
tages of the present invention will become apparent 
from the following description and the appended claims, 
taken in conjunction with the accompanying drawings in 
which like parts or elements are denoted by like refer- 
ence characters. 

FIG. 1 is a block diagram of an image data commu- 
nication system showing a preferred embodiment of 
the present invention; 

FIG. 2 is a diagram illustrating a format of packet 
data used in the image data communication system 
of FIG. 1; 

FIG. 3 is a flow diagram showing a flow of data 
when packet data are transferred in the image data 
communication system of FIG. 1 ; 
FIG. 4 is a diagram illustrating a sequence of oper- 
ations between terminals and a server in the image 
data communication system of FIG. 1 ; 
FIG. 5 is a flow chart illustrating a processing pro- 
cedure of a server controller shown in FIG. 1 ; 
FIG. 6 is a flow chart illustrating a processing pro- 
cedure of terminal information retrieval executed in 
the procedure of FIG. 5; 

FIG. 7 is a flow chart illustrating a processing pro- 
cedure for transfer of packet data executed in the 
procedure of FIG. 5; 

FIG. 8 is a flow chart illustrating a proceeding pro- 
cedure of a terminal control shown in FIG. 1 ; 
FIG. 9 is a flow chart illustrating a processing pro- 
cedure of packet data transmission executed in the 
procedure of FIG. 8; and 

FIG. 10 is a block diagram showing a conventional 
image data communication system. 

Referring first to FIG. 1 , there is shown in block dia- 
gram an image data communication system to which 
the present invention is applied. For convenience of 
illustration and description, the image data communica- 


tion system of FIG. 1 is shown including only two termi- 
nals. 

The image data communication system includes a 
server S, a pair of terminals A and B, and a router R 
which servers as a repeater. In the image communica- 
tion system, packet data are bi-directionally communi- 
cated between the server S and the terminals A and B 
and between the terminals via the router R. 

The server S includes a server controller 21 for con- 
trolling the entire server S, a server communication sec- 
tion 22 for communicating with the terminals A and B, a 
server memory 23 for storing a value of a variable used 
during operation of the server S or temporarily storing 
image data, a storage section 24 formed from a hard 
disk or a like element an image data transfer section 
25, and a terminal information retrieval section 26. 

The storage section 24 includes a terminal informa- 
tion file 24a in which terminal information of a destina- 
tion of image data is described, and an image data file 
24b which includes a plurality of image data. 

Referring to FIG. 2, the terminal information file 24a 
includes a quantity (RJ_eng) of terminal information, an 
address number (R_Addr) of a terminal and a name 
(R_Data) of image data having been sent to the termi- 
nal. 

FIG. 3 illustrates a flow of packet data transferred 
via the router R. Referring to FIG. 3, packet data T rep- 
resents data from a terminal to the server while packet 
data T represents data from the server to another termi- 
nal. The format of the data includes an address number 
Ta of a destination, an address number 7b of a source 
of transmission, coded image data I and so forth. The 
address numbers Ta and Tb are described, for example, 
like 134:403:16523 (server), 134:403:165:62 (terminal 
B) and 134:403:165:45 (terminal A). 

The terminal information retrieval section 26 has a 
function as transmission discrimination means for refer- 
ring, when a request for transmission of particular 
image data is received from one of the terminals, to the 
terminal information file 24a to discriminate whether or 
not the image data have been transmitted already to 
any other terminal. 

The image data transfer section 25 has a function 
of reading out, when image data requested to transmit 
from one of the terminals have not been transmitted as 
yet, the image data from the terminal information file 
24a and transmitting the image data to the terminal from 
which the request for transmission was received, but 
issuing, when the image data have been transmitted 
already, to the terminal to which the image data have 
been transmitted, a request for transmission of the 
image data and transmitting the image data received 
from the terminal in response to the request as packet 
data to the terminal of the source of the request for 
transmission and has another function of modifying an 
address number of such packet data. 

For example, it is assumed to transfer the packet 
data T from the terminal A to the terminal B. In this 
instance, the image data transfer section 25 of the 
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server S modifies the destination address number Ta of 
the packet data T from 134:403:16553 (server) to 
134:403:165:62 (terminal B) and further modifies the 
transmission source address 7b 134:403:165:45 (termi- 
nal A) to 134:403:16553 (server S). The packet data T 
are obtained by the modification. 

When the packet data T whose address numbers 
have been modified in such a manner as described 
above are transmitted to the router R, the router R trans- 
mits the packet data T to the terminal B based on the 
destination address number of the packet data T. By 
modifying the address numbers in this manner, the 
image data which have been transmitted to the terminal 
A can be transferred to the terminal B. 

The terminals A and B are constructed in the follow- 
ing manner. 

Each of the terminals A and B includes a keyboard 

27 for inputting a choice of a user, a terminal controller 

28 for controlling the entire terminal, a terminal commu- 
nication section 29 for communicating with the server S, 
a terminal memory 30 for storing a value of a variable 
used in operation, image data and so forth, a decoding 
section 31 for decoding image data, and an image data 
transmission section 32. 

The image data transmission section 32 has a func- 
tion of transmitting image data stored in the terminal 
memory 30 as packet data in response to a request 
from the server S. 

The router R repeats packet data sent out from the 
server S or the terminal A or B to a terminal or the 
server S specified by the address number of the desti- 
nation included in the packet data. 

Communications of packet data between the termi- 
nals A and B and the server S will be described with ref- 
erence to FIGS. 3 and 4. ft is assumed that, in the 
sequence illustrated in FIG. 4, a request for image data 
to the server S is issued first from the terminal A and 
then from the terminal B, and image data requested of 
the server S from the terminals A and B are the same as 
each other. 

After a request for connection is received from the 
terminal A, if another request for connection (center 
connection request) is received from the terminal B, 
then the server S first transmits a connection permis- 
sion notification to the terminal A and then transmits 
another connection permission notification to the termi- 
nal B. 

The terminal A confirms the connection based on 
reception of the connection permission notification from 
the server S and transmits a request for desired image 
data (video request). Then, the terminal B confirms the 
connection based on reception of the connection per- 
mission notification from the server S and then trans- 
mits a request for desired image data. 

The server S retrieves the image data requested 
from the terminal A from the image data file 24b and 
transmits the retrieved image data as packet data to the 
terminal A. The terminal A thus receives and decodes 
the packet data to reproduce the data. 


On the other hand, since the image data requested 
from the terminal B are the same data as the data which 
have been transmitted to the terminal A, the server S 
requests the terminal A for transmission of the image 

5 data. After confirmation of the request, the terminal A 
makes preparations for transmission and transmits a 
transmission acknowledgment notification of the image 
data to the server S. 

Thereafter, packet data including the requested 

10 image data are transmitted from the terminal A to the 
server S. The server S modifies the address number of 
the destination included in the packet data in such a 
manner as seen in FIG. 3 and transmits the modified 
packet data to the terminal B. The terminal B thus 

is decodes the image data included in the packet data to 
reproduce the data. 

Subsequently, detailed processing operation of the 
server S will be described with reference to FIGS. 5 to 
7. FIG. 5 illustrates processing operation of the server 

20 controller 21 , and FIG. 6 illustrates detailed processing 
of terminal information retrieval included in the proce- 
dure of FIG. 5. ft is to be noted that, while the following 
description given with reference to FIGS. 5 to 7 pro- 
ceeds in such a manner that the server controller 21 

25 itself performs some processing, actually the process- 
ing may be performed by a component of the server S 
having a corresponding function under the control of the 
sever controller 21. 

Step a1 : the server controller 21 controls the server 

30 communication section 22 to connect to the terminal A 
via the router R. 

Step a2: the server controller 21 waits until a 
request from the terminal A is received by the server 
communication section 22. 

35 Step a3: if the request received from the terminal A 
is a request for image data, the server controller 21 
advances the control sequence to step a4, but rf the 
request is a request to end, then the server controller 21 
advances the control sequence to step a1 1 . 

40 Step a4: the server controller 21 refers to the termi- 
nal information file 24a to perform retrieval of terminal 
information. 

Step a5: the server controller 21 discriminates from 
a result of the retrieval whether or not the image data 

45 have been transmitted already, and if the image data 
have not been transmitted, then the server controller 21 
advances the control sequence to step a6, but if the 
image data have been transmitted already, then the 
server controller 21 advances the control sequence to 

so step a9. 

Step a6: the server controller 21 extracts the 
requested image data from the image data file 24b and 
stores the image data into the server memory 23. 

Step a7: the server controller 21 sends packet data 
55 including the image data stored in the server memory 
23 to the terminal A. 

Step a8: the server controller 21 additionally 
describes an address number of the terminal A of the 
destination and a data name of the image data into the 
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terminal information file 24a, and then, the server con- 
troller 21 returns the control sequence to step a2. 

When it is discriminated in step a5 that the image 
data have been transmitted already, the following steps 
are executed subsequently. 

Step a9: the server controller 21 transmits, to the 
terminal A to which the image data have already been 
transmitted, a request for transmission of the image 
data from the server communication section 22. 

Step a10: the server controller 21 transfers the 
received image data as packet data to the terminal B, 
and then the server controller 21 returns the control 
sequence to step a2. 

When it is discriminated in step a3 that the request 
received from the terminal A is a request to end, the fol- 
lowing steps are executed subsequently. 

Step a1 1 : the server controller 21 cuts the connec- 
tion to the terminal. 

Step a12: the server controller 21 deletes the infor- 
mation of the terminal, from which the request to end 
has been received, from the terminal information file 
24a. 

Subsequently details of the terminal information 
retrieval executed in step a4 of the procedure of FIG. 5 
will be described with reference to the flow chart of FIG. 
6. 

Step b1: the server controller 21 compares the 
image data name R_Data of the terminal information file 
with the image data name requested from the terminal 
A. 

Step b2: the server controller 21 discriminates 
whether or not the image data names coincide with 
each other, and if they do not coincide with each other, 
then the server controller 21 advances the control 
sequence to step b3, but rf they coincide with each 
other, then the server controller 21 advances the control 
sequence to step b5. 

Step b3: the server controller 21 discriminates 
whether or not the terminal information has come to an 
end, and if the terminal information has come to an end, 
then the control sequence advances to step b4, but if 
the terminal information has not come to an end, then 
the server controller 21 returns the control sequence to 
stepbl. 

Step b4: the server controller 21 sends back a noti- 
fication that the image data have not been transmitted 
as yet. 

When it is discriminated in step b2 that the com- 
pared image data names coincide with each other, the 
following processing is performed. 

Step b5: the server controller 21 sends back 
another notification that the image data have been 
transmitted already together with the address number 
(R_ Addr) of the terminal of the destination. 

FIG. 7 illustrates detailed processing of the image 
data transfer executed in step a10 of the processing of 
FIG. 5 described hereinabove. 

Step c1 : the server controller 21 stores the destina- 
tion and transmission source address numbers and the 


image data from the terminal A received by the server 
communication section 22 into the server memory 23. 

Step c2: the server controller 21 modifies the desti- 
nation address number and the transmission source 

5 address number stored in the server memory 23. 

Step c3: the server controller 21 transmits packet 
data including the modified address numbers and the 
image data from the server communication section 22 
to the terminal B of the source of the request via the 

io router R. 

Subsequently, detailed processing operation of 
each of the terminals A and B will be described with ref- 
erence to FIG. 8 which illustrates processing operation 
of the terminal controller 28 of a terminal, ft is to be 

is noted that, while the following description given with ref- 
erence to FIGS. 8 and 9 proceeds in such a manner that 
the terminal controller 28 itsetf performs some process- 
ing, actually the processing may be performed by a 
component of the terminal A or B having a correspond- 

20 ing function under the control of the terminal controller 
28. 

Step d1: the terminal controller 28 controls the by 
the terminal communication section 29 to connect to the 
server S via the router R. 

25 Step d2: the terminal controller 28 wafts for input- 
ting of a request from the keyboard 18. 

Step d3: the terminal controller 28 discriminates 
whether or not an inputted request is received, and if a 
request for image data is received, then the terminal 

30 controller 28 advances the control sequence advances 
step d4, but if a request to end is received, then the ter- 
minal controller 28 advances the control sequence to 
step d9. 

Step d4: the terminal controller 28 transmits a 
35 request for image data to the server S via the terminal 
communication section 20. 

Step d5: the terminal controller 28 stores image 
data from the server S received by the terminal commu- 
nication section 29 into the terminal memory 30. 
40 Step d6: the terminal controller 28 decodes the 
image data stored in the terminal memory 30 by the 
decoding section 31. 

Step d7: the terminal controller 28 discriminates 
whether or not a request for transfer has been received, 
45 and if a request for transfer has been received, then the 
terminal controller 28 advances the control sequence to 
step d8, but if no request for transfer has been received, 
then the terminal controller 28 returns the control 
sequence to step d2. 
so Step d8: the terminal controller 28 transmits packet 
data including the image data. 

When it is discriminated in step d3 that a request to 
end is received, the following processing is performed. 

Step d9: the terminal controller 28 transmits a 
55 request to end from the terminal communication section 
29 to the server S. 

Details of the packet data transmission processing 
executed in step d8 of the procedure of FIG. 8 will be 
described with reference to FIG. 9. 
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Step e1 : the terminal controller 28 transmits the 
image data stored in the terminal memory 30 as packet 
data from the terminal communication section 29 to the 
server S. 

Having now fully described the invention, it will be 
apparent to one of ordinary skill in the art that many 
changes and modifications can be made thereto without 
departing from the spirit and scope of the invention as 
set forth herein. 

Claims 


a source of transmission. 

4. An image data communication system as set forth 
in claim 3, characterized in that it further comprises 
5 a router (R) for transmitting the image data toward 
the terminal of the destination based on the 
address number of the destination included in the 
packet data. 


1. An image data communication system which 
includes a server (S) and a plurality of terminals (A, 

B) and wherein image data are communicated is 
between said server (S) and terminals (A, B), char- 
acterized in that it comprises: 

transmission discrimination means (26) pro- 
vided in said server (S) for discriminating 20 
whether or not image data requested from a 
first one of said terminals (A, B) have already 
been transmitted to a second one of said termi- 
nals (A, B); 

image data transfer means (25) provided in 25 
said server (S) for requesting, when a result of 
the discrimination of said transmission discrim- 
ination means (26) is that the data have been 
transmitted already, the second terminal for 
transmission of the image data and transferring 30 
the image data received from the second termi- 
nal to the first terminal; 

terminal side storage means (30) provided in 
each of said terminals (A, B) for storing image 
data; and 35 
image data transmission means (32) provided 
in each of said terminals (A, B) for reading out 
image data requested from said server (S) from 
said terminal side storage means (30) and 
transmitting the read out image data to said 40 
server (S). 

2. An image data communication system as set forth 
in claim 1 , characterized in that it further comprises 
server side storage means (24) provided in said 45 
server (S) for storing a terminal information file 
(24a) including an address number of the second 
terminal and a name of the image data transmitted 

to the second terminal and an image data file (24b) 
including a plurality of image data, said transmis- so 
sion discrimination means (26) referring to said ter- 
minal information file (24a) to discriminate to which 
one of said terminals (A, B) the image data have 
been transmitted. 

ss 

3. An image data communication system as set forth 
in claim 2, characterized in that image data are 
transferred as packet data together with an address 
number of a destination and an address number of 
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FIG. 5 
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